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Box PCT Patent Application 
Assistant Commissioner for Patents 22511 

Washington, DC 20231 PATENT .TRADEMARK OFFICE 

PRELIMINARY AMENDMENT 

Dear Sir: 

Before examining the referenced application on the merits, please amend the 
application as outlined below: 
In the Abstract: 

In line 2, please delete "comprising" and replace with -including-. 
In line 4, please delete "comprising" and replace with -including-. 
In line 7, please delete "comprising" and replace with -including-. 

In the Claims: 

In claim 5, line 1, please delete "any preceding claim" and replace with - claim 

1«. 

In claim 6, line 1, please delete "any preceding claim" and replace with - claim 

1-. 
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In claim 8, line 1, please delete "any preceding claim" and replace with - claim 

I--. 

In claim 14, line 1, please delete "or 13". 

In claim 16, line 1, please delete "any of Claims 1 1 to 15" and replace with -- 

claim 11--. 

In claim 17, line 1, please delete "any of Claims 1 1 to 16" and replace with - 

claim 11-. 

In claim 19, line 1, please delete "any of Claims 1 1 to 18" and replace with - 

claim 11—. 

Please cancel claims 20-22. 

REMARKS 

The claims have been amended to remove multiple dependencies and to correct 
antecedent basis errors. Full examination and favorable action are requested. 
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RECEIVER/DECODER AND METHOD OF PROCESSING VIDEO 



DATA 



10 



15 



20 



25 



The present invention relates to a receiver/decoder and a method of processing video 
data. 

The term "receiver/decoder" used herein may connote a receiver for receiving either 
encoded or non-encoded signals, for example, television and/or radio signals, which 
may be broadcast or transmitted by some other means. The term may also connote 
a decoder for decoding received signals. Embodiments of such receiver/decoders 
may include a decoder integral with the receiver for decoding the received signals, 
for example, in a "set-top box", such a decoder functioning in combination with a 
physically separate receiver, or such a decoder including additional functions, such 
as a web browser, a video recorder, or a television. 

In a broadcast digital television system, received signals are passed to a 
receiver/decoder and thence to a television set. As used herein, the term "digital 
television system" includes for example any satellite, terrestrial, cable and other 
system. The receiver/decoder decodes a compressed MPEG-type signal into a 
television signal for the television set. It is controlled by a remote controller 
handset, through an interface in the receiver/decoder. The receiver/decoder is used 
to process the incoming bit stream, and includes a variety of application modules 
which cause the receiver/decoder to perform a variety of control and other functions. 

Such a receiver/decoder may have a variety of devices coupled to it, such as a card 
reader for the user to pass an authorization card through to confirm which services 
the user is authorized to use, a hand-held television receiver control wand, a 
television display unit, and a second card reader for use with bank cards to allow the 
user to perform home banking functions. It may also have a variety of ports coupled 
to it t for example, a modem for access to the Internet and for conducting home 
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banking transactions. 

The receiver/decoder typically includes a buffering arrangement for handling 
incoming data. The basic principle of buffering in a receiver/decoder is that a 
5 memory section in a memory is designated as a buffer. Incoming data from a port 
is fed into the buffer. The buffer size may be chosen to be large enough to 
accommodate most or all incoming messages, or the buffer may be operated with two 
pointers, one for the point where fresh incoming data is written into the buffer and 
the other for the point where stored data is read from the buffer. 

10 

The receiver/decoder normally includes a 4-layer structure for generating the image 
to be displayed on the television set, the 4 layers being a stills layer, a moving image 
layer, a graphics layer, and a cursor layer. The graphics layer is preferably utilized 
for both icons (typically geometric shapes) and titles (usually but not always 
15 subtitles). The use of a common layer, the graphics layer, for both icons and titles 
causes difficulties in maintaining and updating both the icons and the titles 
satisfactorily, particularly as a title can appear at any position on the screen. 

The main aim of the present invention is to provide an improved buffering 
20 arrangement in a receiver/decoder to solve this and other problems. 

The present invention provides a method of processing video data in a 
receiver/decoder comprising at least one port for receiving data and memory means 
comprising a data buffer area for storing incoming data for display, and a graphics 
25 buffer area for storing graphics data, said method comprising passing graphics data 
stored in the graphics buffer area to the data buffer area for combination with display 
data stored therein. 

In a preferred embodiment, the incoming data comprises video text data, such as one 
30 or more subtitles, and the graphics data comprises icon data. When a subtitle screen 



WO 99/56465 



PCT/IB99/00850 



-3- 

has been fully received in the data buffer area, a central processing unit in the 
receiver/decoder, under the control of a device, passes icon data into the data buffer 
area, preferably just before the data stored in the data buffer area is combined with 
other data to provide video data. Hence, the invention affords the advantage that in 
5 the event of an overlap between the icon and part of the subtitle, the icon can be laid 
over that part of the subtitle, but the non-overlapped parts can be concurrently 
displayed with the icon. 

In a preferred embodiment, the data buffer area comprises two data buffer sub-areas, 
10 said incoming display data being directed into one of said sub-areas at a time. 

The two sub-areas may be interchanged so that further incoming display data is stored 
in the other sub-area and graphics data stored in the graphics buffer area is passed to 
the other sub-area. This can enable a subtitle screen to be stored in one sub-area 
15 whilst a previously received subtitle screen is being output from another sub-area, 
thereby avoiding over-writing of the previously received subtitle screen with fresh 
data. 

Preferably, the two sub-areas are interchanged immediately after graphics data stored 
20 in the graphics buffer area is passed to one of the data buffer sub-areas. 

The graphics buffer area may comprise a plurality of graphics buffer sub-areas in 
which graphics data can be stored, graphics data being passed to the data buffer area 
from a selected one of the graphics buffer sub-areas. This can enable, for example, 
25 a number of different icons to be generated and stored prior to the reception of any 
video text data, so that there is no need for icon generating means to generate 
continuously icon data. 

Preferably, the combined graphics and display data is further combined with other 
30 received data to provide video data. Thus, whilst further incoming display data is 
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being stored in one data buffer sub-area and graphics data stored in the graphics 
buffer area is being passed to that data buffer sub-area, the combined data of the 
other data buffer sub-area can be further combined with the other received data, again 
thereby avoiding over-writing of the previously received subtitle screen with fresh 
5 data. 

Preferably, graphics data stored in the graphics buffer area is passed into the data 
buffer area for combination with display data stored therein immediately before the 
thus combined graphics and display data is combined with said other received data. 

10 

The video data may comprise four layers of data, said combined graphics and display 
data comprising one of said layers. If so, the four layers of data may comprise said 
combined graphics and display data layer, a stills data layer, a moving image data 
layer, and a cursor data layer. 

15 

The moving image data layer and the display data may comprise at least part of an 
MPEG datastream. 

The present invention also provides a receiver/decoder comprising at least one port 
20 for receiving data, memory means comprising a data buffer area for storing incoming 
data for display and a graphics buffer area for storing graphics data, and means for 
passing graphics data stored in the graphics buffer area to the data buffer area for 
combination with display data stored therein. 

25 A preferred embodiment of the receiver/decoder comprises at least one port for 
receiving data, a memory comprising a data buffer area for storing incoming data for 
display and a graphics buffer area for storing graphics data, and a processor for 
passing graphics data stored in the graphics buffer area to the data buffer area for 
combination with display data stored therein. 

30 
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The data buffer area may comprise two data buffer sub-areas, and the 
receiver/decoder may further comprise means, for example, a microprocessor, for 
directing incoming data into one of said sub-areas. 

5 The receiver/decoder may further comprise control means, such as, for example, a 
device, the directing means being arranged to direct incoming display data to one of 
the data buffer sub-areas as specified by said control means. 

The receiver/decoder may further comprise means, for example, a device, for 
10 interchanging the two sub-areas so that further incoming display data is storable in 
the other sub-area and graphics data stored in the graphics buffer area is passable to 
the other sub-area. 

The interchanging means may be adapted to interchange the two data buffer sub-areas 
15 immediately after graphics data stored in the graphics buffer area is passed to one of 
the data buffer sub-areas. 

The graphics buffer area may comprise a plurality of graphics buffer sub-areas in 
which graphics data is storable, graphics data being passable to the data buffer area 
20 from a selected one of the graphics buffer sub-areas. 

The receiver/decoder may further comprise means for combining the combined 
graphics and display data with other received data to provide video data. IN one 
preferred embodiment, the combining means is a mixing circuit. 

25 

The passing means may be arranged to pass graphics data stored in the graphics 
buffer area into the data buffer area for combination with display data stored therein 
immediately before combining means combines the combined graphics and display 
data with said other received data. 

30 
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The receiver/decoder may further comprise buffer control means, such as, for 
example, a device, the data buffer sub-areas being defined by the buffer control 
means. 

5 The present invention also extends to a broadcast and reception system including a 
receiver/decoder as aforementioned, and means for broadcasting said data. In a 
preferred embodiment, the system is a digital television system. 

Various functions of the receiver/decoder may be implemented in hardware, for 
10 example in a dedicated integrated circuit; this may provide enhanced speed of 
operation. Preferably, however, at least some of the functions are implemented in 
software, preferably implemented by processing means which runs the applications; 
this can allow greater flexibility, require less components, and allow the 
receiver/decoder to be updated more readily. 

15 

Receiver/decoders embodying the invention will now be described, by way of 
example, with reference to the drawings, in which: 

Figure 1 is a schematic diagram of a digital television system; 

20 

Figure 2 is a schematic diagram of the structure of a receiver/decoder of the system 
of Figure 1; 

Figure 3 is a functional block diagram of the layered architecture of the 
25 receiver/decoder; 

Figure 4 is a schematic diagram of the arrangement of the graphic processor of the 
receiver/decoder; 



30 Figure 5 is a schematic diagram of a RAM memory of the graphic processor; and 
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Figure 6 is a schematic diagram illustrating the combination of layers of a video 
display. 

An overview of a digital television system 1 is shown in Figure 1. The invention 
5 includes a mostly conventional digital television system 2 that uses the known MPEG- 
2 compression system to transmit compressed digital signals. In more detail, MPEG- 
2 compressor 3 in a broadcast centre receives a digital signal stream (typically a 
stream of video signals). The compressor 3 is connected to a multiplexer and 
scrambler 4 by linkage 5. 

10 

The multiplexer 4 receives a plurality of further input signals, assembles the transport 
stream and transmits compressed digital signals to a transmitter 6 of the broadcast 
centre via linkage 7, which can of course take a wide variety of forms including 
telecommunications links. The transmitter 6 transmits electromagnetic signals via 

15 uplink 8 towards a satellite transponder 9, where they are electronically processed and 
broadcast via notional downlink 10 to earth receiver 12, conventionally in the form 
of a dish owned or rented by the end user. The signals received by receiver 12 are 
transmitted to an integrated receiver/decoder 13 owned or rented by the end user and 
connected to the end user's television set 14. The receiver/decoder 13 decodes the 

20 compressed MPEG-2 signal into a television signal for the television set 14. 

Other transport channels for transmission of the data are of course possible, such as 
terrestrial broadcast, cable transmission, combined satellite/cable links, telephone 
networks etc. 

25 

In a multichannel system, the multiplexer 4 handles audio and video information 
received from a number of parallel sources and interacts with the transmitter 6 to 
broadcast the information along a corresponding number of channels. In addition to 
audiovisual information, messages or applications or any other sort of digital data 
30 may be introduced in some or all of these channels interlaced with the transmitted 
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digital audio and video information. 

A conditional access system 15 is connected to the multiplexer 4 and the 
receiver/decoder 13, and is located partly in the broadcast centre and partly in the 
5 decoder. It enables the end user to access digital television broadcasts from one or 
more broadcast suppliers. A smartcard, capable of deciphering messages relating to 
commercial offers (that is, one or several television programmes sold by the broadcast 
supplier), can be inserted into the receiver/decoder 13. Using the decoder 13 and 
smartcard, the end user may purchase commercial offers in either a subscription mode 
10 or a pay-per-view mode. 

As mentioned above, programmes transmitted by the system are scrambled at the 
multiplexer 4, the conditions and encryption keys applied to a given transmission 
being determined by the access control system 15. Transmission of scrambled data 
15 in this way is well known in the field of pay TV systems. Typically, scrambled data 
is transmitted together with a control word for descrambling of the data, the control 
word itself being encrypted by a so-called exploitation key and transmitted in 
encrypted form. 

20 The scrambled data and encrypted control word are then received by the decoder 13 
having access to an equivalent to the exploitation key stored on a smart card inserted 
in the decoder to decrypt the encrypted control word and thereafter descramble the 
transmitted data. A paid-up subscriber will receive, for example, in a broadcast 
monthly ECM (Entitlement Control Message) the exploitation key necessary to 

25 decrypt the encrypted control word so as to permit viewing of the transmission. 

An interactive system 16, also connected to the multiplexer 4 and the 
receiver/decoder 13 and again located partly in the broadcast centre and partly in the 
decoder, enables the end user to interact with various applications via a modern back 
30 channel 17. The modem back channel may also be used for communications used in 
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the conditional access system 15. An interactive system may be used, for example, 
to enable the viewer to communicate immediately with the transmission centre to 
demand authorisation to watch a particular event, download an application etc. 

5 Referring to Figure 2, the elements of the receiver/decoder 13 or set-top box will 
now be described. The elements shown in this figure will be described in terms of 
functional blocks. 

The decoder 13 comprises a central processor 20 including associated memory 
10 elements and adapted to receive input data from a serial interface 21, a parallel 
interface 22, a modem 23 (connected to the modem back channel 17 of Fig. 1), and 
switch contacts 24 on the front panel of the decoder. 

The decoder is additionally adapted to receive inputs from an infra-red remote control 
15 25 via a control unit 26 and also possesses two smartcard readers 27, 28 adapted to 
read bank or subscription smartcards 29, 30 respectively. The subscription smartcard 
reader 28 engages with an inserted subscription card 30 and with a conditional access 
unit 29 to supply the necessary control word to a demultiplexer/descrambler 30 to 
enable the encrypted broadcast signal to be descrambled. The decoder also includes 
20 a conventional tuner 31 and demodulator 32 to receive and demodulate the satellite 
transmission before being filtered and demultiplexed by the unit 30. 

Processing of data within the decoder is generally handled by the central processor 
20. Figure 3 illustrates the software architecture of the central processor 20 of the 
25 receiver/decoder. With reference to Figure 3, the software architecture comprises a 
Run-Time-Engine 4008, a Device Manager 4068 and a plurality of Devices 4062 and 
Device Drivers 4066 for running one or more applications 4056. 

As used in this description, an application is a piece of computer code for controlling 
30 high level functions of preferably the receiver/decoder 13. For example, when the 
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end user positions the focus of remote control 25 on a button object seen on the 
screen of the television set 14 and presses a validation key, the instruction sequence 
associated with the button is run. 

An interactive application proposes menus and executes commands at the request of 
the end user and provides data related to the purpose of the application. Applications 
may be either resident applications, that is, stored in the ROM (or FLASH or other 
non-volatile memory) of the receiver/decoder 13, or broadcast and downloaded into 
the RAM or FLASH memory of the receiver/decoder 13. 

Applications are stored in memory locations in the receiver/decoder 13 and 
represented as resource files. The resource files comprise graphic object description 
unit files, variables block unit files, instruction sequence files, application files and 
data files, as described in more detail in the above-mentioned patent specifications. 

The receiver/decoder contains memory divided into a RAM volume, a FLASH 
volume and a ROM volume, but this physical organization is distinct from the logical 
organization. The memory may further be divided into memory volumes associated 
with the various interfaces. From one point of view, the memory can be regarded 
as part of the hardware; from another point of view, the memory can be regarded as 
supporting or containing the whole of the system shown apart from the hardware. 

The central processor 20 can be regarded as centred on a run time engine 4008 
forming part of a virtual machine 4007. This is coupled to applications on one side 
(the "high level" side), and, on the other side (the "low level" side), via various 
intermediate logical units discussed below, to the receiver/decoder hardware 4061, 
comprising the various ports as discussed above (that is, for example, the serial 
interface 21, the parallel interface 22, modem 23, and control unit 26). 

With specific reference to Figure 3, various applications 4057 are coupled to the 



WO 99/56465 



PCT/IB99/00850 



-11- 

virtual machine 4007; some of the more commonly used applications may be more 
or less permanently resident in the system, as indicated at 4057, while others will be 
downloaded into the system, eg from the MPEG data stream or from other ports as 
required. 

5 

The virtual machine 4007 includes, in addition to the run time engine 4008, some 
resident library functions 4006 which include a toolbox 4058. The library contains 
miscellaneous functions in C language used by the engine 4008. These include data 
manipulation such as compression, expansion or comparison of data structures, line 
10 drawing, etc. The library 4006 also includes information about firmware in the 
receiver/decoder 13, such as hardware and software version numbers and available 
RAM space, and a function used when downloading a new device 4062. Functions 
can be downloaded into the library, being stored in FLASH or RAM memory. 

15 The run time engine 4008 is coupled to a device manager 4068 which is coupled to 
a set of devices 4062 which are coupled to device drivers 4060 which are in turn 
coupled to the ports or interfaces. In broad terms, a device driver can be regarded 
as defining a logical interface, so that two different device drivers may be coupled 
to a common physical port. A device will normally be coupled to more than one 

20 device driver; if a device is coupled to a single device driver, the device will 
normally be designed to incorporate the full functionality required for communication, 
so that the need for a separate device driver is obviated. Certain devices may 
communicate among themselves. 

25 As will be described below, there are 3 forms of communication from the devices 
4064 up to the run time engine: by means of variables, buffers, and events which are 
passed to a set of event queues. 

Each function of the receiver/decoder 13 is represented as a device 4062 in the 
30 software architecture of the receiver/decoder 13. Devices can be either local or 
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remote. Local devices 4064 include smartcards, SCART connector signals, modems, 
serial and parallel interfaces, a MPEG video and audio player and an MPEG section 
and table extractor. Remote devices 4066, executed in a remote location, differ from 
local devices in that a port and procedure must be defined by the system authority or 
5 designer, rather than by a device and device driver provided and designed by the 
receiver/decoder manufacturer. 

The run time engine 4008 runs under the control of a microprocessor and a common 
application programming interface. They are installed in every receiver/decoder 13 
10 so that all receiver/decoders 13 are identical from the application point of view. 

The engine 4008 runs applications 4056 on the receiver/decoder 13. It executes 
interactive applications 4056 and receives events from outside the receiver/decoder 
13, displays graphics and text, calls devices for services and uses functions of the 
15 library 4006 connected to the engine 4008 for specific computation. 

The run time engine 4008 is an executable code installed in each receiver/decoder 13, 
and includes an interpreter for interpreting and running applications. The engine 
4008 is adaptable to any operating system, including a single task operating system 

20 (such as MS-DOS). The engine 4008 is based on process sequencer units (which take 
various events such as a key press, to carry out various actions), and contains its own 
scheduler to manage event queues from the different hardware interfaces. It also 
handles the display of graphics and text. A process sequencer unit comprises a set 
of action-groups. Each event causes the process sequencer unit to move from its 

25 current action-group to another action-group in dependence on the character of the 
event, and to execute the actions of the new action-group. 

The engine 4008 comprises a code loader to load and download applications 4056 into 
the receiver/decoder memory. Only the necessary code is loaded into the RAM or 
30 FLASH memory, in order to ensure optimal use. The downloaded data is verified 
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by an authentication mechanism to prevent any modification of an application 4056 
or the execution of any unauthorized application. The engine 4008 further comprises 
a decompressor. As the application code (a form of intermediate code) is compressed 
for space saving and fast downloading from the MPEG stream or via a built-in 
5 receiver/decoder mode, the code must be decompressed before loading it into the 
RAM. The engine 4008 also comprises an interpreter to interpret the application 
code to update various variable values and determine status changes, and an error 
checker. 

10 Before using the services of any device 4062, a program (such as an application 
instruction sequence) has to be declared as a "client", that is, a logical access-way to 
the device 4062 or the device manager 4068. The manager gives the client a client 
number which is referred to in all accesses to the device. A device 4062 can have 
several clients, the number of clients for each device 4062 being specified depending 

15 on the type of device 4062. A client is introduced to the device 4062 by a procedure 
"Device: Open Channel". This procedure assigns a client number to the client. A 
client can be taken out of the device manager 4068 client list by a procedure "Device: 
Close Channel". 

20 The access to devices 4062 provided by the device manager 4068 can be either 
synchronous or asynchronous. For synchronous access, a procedure "Device: Call" 
is used. This is a means of accessing data which is immediately available or a 
functionality which does not involve waiting for the desired response. For 
asynchronous access, a procedure "Device: I/O" is used. This is a means of 

25 accessing data which involves waiting for a response, for example scanning tuner 
frequencies to find a multiplex or getting back a table from the MPEG stream. 
When the requested result is available, an event is put in the queue of the engine to 
signal its arrival. A further procedure "Device: Event" provides a means of 
managing unexpected events. 



30 
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As noted above, the main loop of the run time engine is coupled to a variety of 
process sequencer units, and when the main loop encounters an appropriate event, 
control is temporarily transferred to one of the process sequencer units. 

5 Thus, it can be seen that the central processor 20 provides a platform having 
considerable flexibility in enabling an application to communicate with a variety of 
devices. 

In the case of received audio and video signals, the MPEG packets containing these 
10 signals will be demultiplexed and filtered so as to pass real time audio and video data 
in the form of a packetised elementary stream (PES) of audio and visual data to 
dedicated audio and video processors or decoders 33, 34. The converted output from 
the audio processor 33 passes to a preamplifier 35 and thereafter via the audio output 
of the receiver/decoder. The converted output from the video processor 34 passes 
15 via a graphic processor 36 and PAL/SECAM encoder 37 to the video output of the 
receiver/decoder. 

With reference to Figure 2, the graphic processor 36 is preferably designed to 
generate a screen display combining moving images together with overlaid text or 
20 other images. More specifically it can combine 4 layers; a stills layer, a moving 
image layer, a graphics layer, and a cursor layer. As described in more detail below, 
the graphic processor 36 additionally receives graphic data for display (such as 
generated images etc) from the central processor 20 and combines this information 
with information received from the video processor 34 to generate the screen display. 

25 

As shown in more detail in Figure 4, the graphic processor 36 includes dedicated 
RAM memory area 40, dedicated microprocessor 41 and graphics library 42. With 
reference to Figure 5, the RAM memory area 40 of the graphic processor 36 is 
divided into a number of buffer areas; a stills layer buffer area 43, a moving image 
30 layer buffer area 44 and a graphics layer buffer area 45. 
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The stills layer is used for background images of a broadly static nature. The 
circuitry and software associated with the stills layer buffer area 43 can preferably 
generate an image therein by any desired combination of the following processes: 

generating and filling rectangles with specific colours (defined by up to 24 
5 bits); 

copying images received from the MPEG data stream; 

repeating an image occupying less than the full screen area, to produce a 

wallpaper effect. 

10 The moving image layer is used for the incoming video signals obtained from the 
MPEG data stream. The circuitry and software associated with the moving image 
layer buffer area 44 can preferably resize and scale the incoming images, and 
combine images from a plurality of sources into different areas of the buffer area. 

15 The graphics layer is used to produce titles and icons (graphics) . Titles are frequently 
subtitles, which appear centred near the lower edge of the image, but may also appear 
in other positions on the image. Icons are generally geometric shapes such as 
rectangles, circles, buttons, and dialogue boxes (it will be realized that the term 
"icon" is here being used in a broad sense). 

20 

The graphics layer is defined by one or more rectangular regions, each rectangular 
region being defined by the coordinates of the upper left corner of the region and the 
size of the region. Accordingly, the graphics layer buffer area 45 is sub-divided into 
a plurality of buffer regions 45A, 45B, ... 45N, one buffer region for each of the 
25 rectangular regions of the graphics layer. Each buffer region 45A... comprises a 
plurality of sub-areas 45 A 0 , 45A ! ...45A n . Each buffer region is created by a 
"subtitle" device 4062, under the control of an application 4056, in the central 
processor 20 using a command procedure stored in the graphics library 42. 

30 With reference to Figure 6, the contents of the stills layer buffer area 43 and the 
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moving image layer buffer area 44, as they are read out, are mixed together by a 
mixing circuit 50 which can be set to blend (alpha blending, that is, translucently) 
those outputs; and the output of that mixing circuit 50 is combined with the contents 
of the graphics layer buffer area 45, as those contents are read out, by a similar 
mixing circuit 51. 

The output of that mixing circuit is combined with the output of a hardware cursor 
generator 52 by a combining circuit 53 which superposes a cursor signal on the 
combination of the first 3 layers. The cursor layer is preferably superposed opaquely, 
that is, without the option of blending, on the combination of the first 3 layers, so 
that the combination of the first 3 layers is wholly obscured within the area of the 
cursor. However, one of the bit values available for the cursor pixels is preferably 
"transparent", so that the cursor can effectively have "holes" in it through which the 
underlying combined image from the first 3 layers can be seen. 

This 4-layer structure produces potential problems with respect to the third layer, that 
is, the graphics layer. These problems arise because two separate types of display 
element, titles and icons, are being generated in the same layer. There is therefore 
the possibility of conflict between these two types of display element. For example, 
it will often be desirable to change the titles and the icons at different times (and often 
it will be desirable for the icons to remain in place for longer than the titles). As 
noted above, the fact that titles may appear in any position on the display, rather than 
solely in the standard subtitle position, means that such possibility of conflict is 
substantial. 

To overcome this problem, each buffer region 45A, 45B... includes two buffer sub- 
areas 45A° and 45A 1 which are reserved for use by the subtitle device 4062 to build 
and display subtitles. 

The subtitle device 4062 in the central processor 20 selects which of the two buffer 
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sub- areas 45 A 0 and 45 A 1 is to be used to receive incoming data for display and 
outputs an appropriate command to the graphic processor 36. In turn, the 
microprocessor 41 of the graphic processor 36 directs incoming data to the selected 
buffer sub-area. For this purpose, the two buffer sub-areas 45A° and 45A 1 are treated 
5 as a "working buffer" and a "display buffer". The sub-area into which currently 
incoming data is fed is the working buffer, so its contents will be changing. 

The received data (subtitles) is directed into the two buffers sub-areas 45 A 0 and 45 A 1 
alternately. In other words, the subtitle device 4062 reverses the roles of the two 

10 sub-areas each time the working buffer has a new complete subtitle page to display, 
as the contents of that sub-area are no longer changing, giving a steady image which 
is acceptable to the viewer so that sub-area can be used as the display buffer. The 
contents of the display buffer are read out as the graphics layer for combination with 
the combined stills layer and moving image layer. The interval between the 

15 interchange of the roles of the two sub-areas 45 A 0 and 45 A 1 , that is, between the 
interchange of the working and display buffers, is typically 5 to 10 s. At that point, 
the subtitle device 4062 in the central processor 20 outputs an appropriate command 
to the graphic processor 36 to interchange the roles of the two sub-areas 45 A 0 and 
45A 1 , and, in turn, the microprocessor 41 of the graphic processor 36 clears the 

20 contents of the other sub-area and directs incoming data to that sub-area. 

Each buffer region 45 A, 45B. includes a further buffer area, namely an icon buffer 
area 45 A 1 , 45B'. . . . , as shown in Figure 5 . Each icon buffer area 45 A 1 comprises one 
or more icon buffer sub-areas, 45A 2 , 45A\ . . up to 45A 15 . Each icon buffer sub-area 

25 contains respective icon image data. The icon image may be generated by software 
stored in the central processor 20, stored in the RAM area 20A (or FLASH memory 
area) of the central processor 20 and copied by the central processor 20 into a 
designated icon buffer sub-area of the RAM area 41 of the graphic processor 36. 
Once an icon image has been stored in the graphic processor 36, it remains in its 

30 buffer sub-area and can be copied repeatedly to either of the two buffer sub-areas 
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45A° and 45A 1 whenever required. In this way, a whole series of icon images can 
be constructed, which can be used in whatever sequences and at whatever times are 
required. 

The combination of the two images, the subtitles image in one or other of the buffer 
sub-areas 45 A 0 and 45 A 1 and the icon image in the icon buffer area 45 A , is achieved 
by copying the icon image into the working buffer, that is, into whichever of the two 
sub-areas 45A° and 45A 1 is not currently the display buffer. As specified by the 
controlling application, the subtitle device 4062 outputs an appropriate command to 
the graphic processor 36 to copy the contents of a specified icon buffer sub-area to 
the working buffer just before the working buffer is to become the display buffer, that 
is, when a complete subtitle page has been stored in the working buffer. 

With the above arrangement, the icon image currently being displayed is stored in the 
display buffer, the next icon image to be displayed may already be stored in the 
working buffer, and a fresh icon image may be under construction by the icon 
generator while the working buffer is receiving subtitles data. This arrangement 
requires synchronism between the interchanging of the working and adjacent play 
buffers and the construction of fresh icon images. 

At any time, the application controlling the subtitle device 4062 may require the 
currently displayed icon image to be changed without alteration of the displayed 
subtitle, for example, upon input of a command from the remote control 25. In this 
case, the subtitle device 4062 outputs a command to the graphic processor 36 to copy 
an icon image stored in the icon buffer area immediately into the display buffer over 
the icon image already stored therein. 

In summary, when a subtitle screen has been fully received in the data buffer area, 
a central processing unit in the receiver/decoder, under the control of a device, passes 
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icon data into the data buffer area, preferably just before the data stored in the data 
buffer area is combined with other data to provide video data. Hence, in the event 
of an overlap between the icon and part of the subtitle, the icon can be laid over that 
part of the subtitle, but the non-overlapped parts can be concurrently displayed with 
5 the icon. 

The precise details of the implementation of the various functions described above, 
and their distribution between hardware and software, are a matter of choice for the 
implementor and will not be described in detail. It is, however, noted that dedicated 

10 integrated circuits capable of performing the operations required in the 
receiver/decoder are commercially available or can be readily designed, and these can 
be used as the basis for a hardware accelerator, or more preferably modified to 
produce a dedicated hardware accelerator, to implement various of the operations 
required, thereby reducing the processing power required to run the software. 

15 However, the operations required may be implemented in software if sufficient 
processing power is available. 

The modules and other components have been described in terms of the features and 
functions provided by each component, together with optional and preferable features. 

20 With the information given and specifications provided, actual implementation of 
these features and the precise details are left to the implementor. As an example, 
certain modules could be implemented in software, preferably written in the C 
programming language and preferably compiled to run on the processor used to run 
the application; however, some components may be run on a separate processor, and 

25 some or all components may be implemented by dedicated hardware. 

The above modules and components are merely illustrative, and the invention may be 
implemented in a variety of ways, and, in particular, some components may be 
combined with others which perform similar functions, or some may be omitted in 
30 simplified implementations. Hardware and software implementations of each of the 
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functions may be freely mixed, both between components and within a single 
component. 

It will be readily understood that the functions performed by the hardware, the 
5 computer software, and such like are performed on or using electrical and like 
signals. Software implementations may be stored in ROM, or may be patched in 
FLASH. 

It will be understood that the present invention has been described above purely by 
10 way of example, and modifications of detail can be made within the scope of the 
invention. Each feature disclosed in the description, and (where appropriate) the 
claims and drawings may be provided independently or in any appropriate 
combination. 
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CLAIMS 

1. A method of processing video data in a receiver/decoder comprising at least 
one port for receiving data and memory means comprising a data buffer area for 
storing incoming data for display, and a graphics buffer area for storing graphics 
data, said method comprising passing graphics data stored in the graphics buffer area 
to the data buffer area for combination with display data stored therein. 

2. A method according to Claim 1, wherein the data buffer area comprises two 
data buffer sub-areas, said incoming display data being directed into one of said sub- 
areas at a time. 

3. A method according to Claim 2, wherein the two sub-areas are interchanged 
so that further incoming display data is stored in the other sub-area and graphics data 
stored in the graphics buffer area is passed to the other sub-area. 

4. A method according to Claim 3, wherein the two sub-areas are interchanged 
immediately after graphics data stored in the graphics buffer area is passed to one of 
the data buffer sub-areas. 

5. A method according to any preceding claim, wherein the graphics buffer area 
comprises a plurality of graphics buffer sub-areas in which graphics data is stored, 
graphics data being passed to the data buffer area from a selected one of the graphics 
buffer sub-areas. 

6. A method according to any preceding claim, wherein the combined graphics 
and display data is further combined with other received data to provide video data. 

7. A method according to Claim 6, wherein graphics data stored in the graphics 
buffer area is passed into the data buffer area for combination with display data stored 
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therein immediately before the thus combined graphics and display data is combined 
with said other received data. 

8. A method according to any preceding claim, wherein the video data comprises 
four layers of data, said combined graphics and display data comprising one of said 
layers. 

9. A method according to Claim 8, wherein the four layers of data comprise said 
combined graphics and display data layer, a stills data layer, a moving image data 
layer, and a cursor data layer. 

10. A method according to Claim 9, wherein the moving image data layer and the 
display data comprise at least part of an MPEG datastream. 

11. A receiver/decoder comprising at least one port for receiving data, memory 
means comprising a data buffer area for storing incoming data for display and a 
graphics buffer area for storing graphics data, and means for passing graphics data 
stored in the graphics buffer area to the data buffer area for combination with display 
data stored therein. 

12. A receiver/decoder according to Claim 11, wherein said data buffer area 
comprises two data buffer sub-areas, and the receiver/decoder further comprises 
means for directing incoming data into one of said sub-areas, 

13. A receiver/decoder according to Claim 12, further comprising control means, 
the directing means being arranged to direct incoming display data to one of the data 
buffer sub-areas as specified by said control means. 

14. A receiver/decoder according to Claim 12 or 13, further comprising means for 
interchanging the two sub-areas so that further incoming display data is storable in 
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the other sub-area and graphics data stored in the graphics buffer area is passable to 
the other sub-area. 

15. A receiver/decoder according to Claim 14, wherein the interchanging means 
5 is adapted to interchange the two data buffer sub-areas immediately after graphics 

data stored in the graphics buffer area is passed to one of the data buffer sub-areas. 

16. A receiver/decoder according to any of Claims 11 to 15, wherein the graphics 
buffer area comprises a plurality of graphics buffer sub-areas in which graphics data 

10 is storable, graphics data being passable to the data buffer area from a selected one 
of the graphics buffer sub-areas. 

17. A receiver/decoder according to any of Claims 11 to 16, further comprising 
means for combining the combined graphics and display data with other received data 

15 to provide video data. 

18. A receiver/decoder according to Claim 17, wherein the passing means is 
arranged to pass graphics data stored in the graphics buffer area into the data buffer 
area for combination with display data stored therein immediately before combining 

20 means combines the combined graphics and display data with said other received data. 

19. A broadcast and reception system including a receiver/decoder according to 
any of Claims 11 to 18, and means for broadcasting said data. 

25 20. A method of processing video data in a receiver/decoder substantially as 
herein described with reference to the accompanying drawings. 

21. A receiver/decoder substantially as herein described with refernce to the 
accompanying drawings. 

30 



WO 99/56465 



PCT/IB99/00850 



-24- 

22, A broadcast and reception system substantially as herein described with 
reference to the accompanying drawings. 



WO 99/56465 



1 / 6 



09/674079 

PCT/IB99/00850 




WO 99/56465 



2 / 6 



09/67407 

PCT/IB99/00850 



CO- 



CM 
CM 



00 \ 



□ 



LU 

DC GC 
UJ LU 



CO 
CM 



I UJ 

LU O 
_l < 
—I UL 
<CC 
CC LU 
< h- 
CL Z 



CM 



1 



< 



_ cc 

Q LU 
CC Q 
< < 
O LU 
CC 



i 



C\J 



I 





h- _i 


LU 


-Z. LU 


Q 




O 


CC < 




U_ CL 



CD 
C\J 



CD 
CO 



>■ 



Q 



CO 
CM 



7 









< 




^CO 




O CO 




i= LU 
£° 




o o 




2 < 




o 




o 



CM 



7 



o 




I 





CC 




oo 








CL LU 




<o 




ceo 




CD CC 







o 

CM 



CC 
LU 
_J 

m 

< 
cc 
o 

CO 
LU 

a 

cc 
=> 

LU 
X 
LU 

I 

Ql 



LU 
Q 



CO 



O 

LU 
Q 

> 



CC 
LU 
Q 
O 
O 
LU 

a 



o 

Q 
< 



CC 
LU 

a 
o 
o 

LU 

a 



CO, 
CO 



O " J 

o 



O LU 
LU Q 

co O 



< 

£L 



oo 



a. 
< 

LU 
CC 

a. 



LU 

h- 
O 

LU 
CC 



o 
cc 

o 1 
o 



ID 
CM 



7 



=3 
CL 

Z) 

o 
o 

LU 

q 
> 



!— 

Q_ 
f- 
=> 

► o 

o 

Q 

< 



WO 99/56465 



3 / 6 



09/674079 

PCT/IB99/00850 



4056 



r 



Fig.3. 

4057 40.56 



APP 



APP 



4007 



4006 



-4008 



RTE 



LIB 



4058 



TOOL 
BOX 



I 



4068 



DEV MAN 



4062 



I 



4060 



DEV 




DEV 




DEV 
DR 




DEV 
DR 




i 






l/F 




l/F 



4064 



I 



4066 



DEV 



DEV 
DR 



LI 



l/F 



HW 



4061 



WO 99/56465 



PCTAB99/00850 



/ 6 



Fig.4. 



MICROPROCESSOR 




RAM 
20A 







RAM 






40 





GRAPHICS 
LIBRARY 
42 



36 y 
GRAPHIC 
PROCESSOR 



ENCODER 
37 



WO 99/56465 



09/67*0'* 

PCT/1B99/00850 



uj o 

Z) LU lo 
CG EC 



m 

in 



LO 



< 

en 
o 



LO 
Ll_ 



< 
111 
CE 
< 

CE 
LU 
IX. 
LL 
Z) 
CD 

CE 
LU 
>- 
< 



C/5 



31 



< 

LU 
CE 
< 

LU 
LL 
LL 
3 
CO 

CE 
LU 
> 
< 



51 



LU 

© 
< 



CD 
> 

o 



lo 



LO 



IT) 



< 
in 



°< 

in 



CO CE CE < LO 
O LU LU LU 

x>H-ce 



Q_ 
< 
CE 
CD 



<ij5< 

CD 



WO 99/56465 



6 / 6 



U7/ t) ( * ' 

PCT/IB99/00850 



STILLS LAYER 
BUFFER AREA 
43 



Fig.6. 



MOVING IMAGE 
LAYER BUFFER 
AREA 
44 



MIXING CIRCUIT 
50 




MIXING 
CIRCUIT 
51 



COMBINING 
CIRCUIT 
53 



GRAPHICS 




LAYER 




BUFFER AREA 




45 






"52 
CURSOR 
GENERATOR 



PTO/SB/105(2-98) 
Approved for use through 9/30/98. OMB 0651-0032 

Express Mail Label No. EL521607276US Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE 
Under the Paperwork Reduction Act of 1 995, no persons are required to respond to a collection of i nformation unless it displays a valid OMB control number 



Declaration and Power of Attorney for Patent Application 



Declaration et Pouvoirs pour Demande de Brevet 

French Language Declaration 

22511 

PATENT .TRADEMARK OFFICE 




En tant que l'inventeur nomme ci-apres, je declare par le present As a below named inventor, I hereby declare that: 
acte que: 

Mon domicile, mon adresse postale et ma nationals sont ceux My residence, post office address and citizenship are as stated 

figurant ci-dessous a cote de mon nom. next to my name. 



Je crois etre le premier inventeur original et unique (si un seul 
nom est mentionne ci-dessous), ou Tun des premiers 
co-inventeurs originaux (si plusieurs noms sont mentionnes 
ci-dessous) de l'objet revendique, pour lequel une demande de 
* brevet a ete deposee concernant l'invention intitulee 



I believe I am the original, first and sole inventor (if only one 
name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention 
entitled 

RECEIVER/DECODER AND METHOD OF PROCESSING 
VIDEO DATA 



et dont la description est fournie ci-joint a moins que la case 
suivante n'ait ete cochee: 



□ a ete deposee le 



sous le numero de demande des Etats-Unis ou le numero 
de demande international PCT 

et modifiee le 

(le cas echeant). 



Je declare par le present acte avoir passe en revue et compris le 
contenu de la description ci-dessus, revendications comprises, 
telles que modifiees par toute modification dont il aura ete fait 
reference ci-dessus. 



the specification of which is attached hereto unless the 
following box is checked: 



□ was filed on 

as United States Application Number or PCT 

International Application Number 

and was amended on 

(if applicable). 



I hereby state that I have reviewed and understand the contents 
of the above identified specification, including the claims, as 
amended by any amendment referred to above. 



Je reconnais devoir divulguer toute information pertinente a la 
brevetabilite, comme defini dans le Titre 37, § 1.56 du Code 
federal des reglementations. 



I acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of 
Federal Regulations, § 1.56. 
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Burden Hour Statement: This form is estimated to take 0.4 hours to complete. Time will vary depending upon the needs of *• 

amount of time you are required to complete this form should be sent to the Chief Information Officer, Patent and Trademark Office, Washington, DC 20231 . DO NOT 
SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington, DC 20231. 
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French Language Declaration 

Je revendique par le present acte avoir la priorite etrangere, en vertu 
du Titre 35, § 119(a)-(d) ou § 365(b) du Code des Etats-Unis, sur 
toute demande etrangere de brevet ou certificat d'inventeur ou, en 
vertu du Titre 35, § 365(a) du meme Code, sur toute demande 
internationale PCT designant au moins un pays autre que les 
Etats-Unis et figurant ci-dessous et, en cochant la case, j'ai aussi 
indique ci-dessous toute demande etrangere de brevet, tout certificat 
d'inventeur ou toute demande internationale PCT ayant une date de 
depot precedant celle de la demande a propos de laquelle une priorite 
est revendiquee. 

Prior foreign application(s) 
Demande(s) de brevet anterieure(s) 



I hereby claim foreign priority under Title 35, United States Code, 
§ 119(a)-(d) or § 365(b) of any foreign application(s) for patent or 
inventor's certificate, or § 365(a) of any PCT International 
application which designated at least one country other than the 
United States, listed below, and have also identified below, by 
checking the box, any foreign application for patent or inventor's 
certificate, or PCT International application having a filing date 
before that of the application on which priority is claimed. 



98401075.1 



Europe 



29 April 1998 



Priority Not Claimed 
Droit de priorite revendique 

□ 



(Number) 
(Numero) 



(Country) 
(Pays) 



(Number) 
(Numero) 



(Country) 
(Pays) 



(Day/Month/Year Filed) 
(Jour/Mois/Annee de depot) 



(Day/Month/Year Filed) 
(Jour/Mois/Annee de depot) 



□ 



Je revendique par le present acte tout benefice, en vertu du Titre 
35, § 119(e) du Code des Etats-Unis, de toute demande de brevet 
provisoire effectuee aux Etats-Unis et figurant ci-dessous. 



I hereby claim the benefit under Title 35, United States Code, 
§1 19(e) of any United States provisional application(s) listed below. 



(Application No.) 
(N°de demande) 



(Filing Date) 
(Date de depot) 



(Application No.) 
(N°de demande) 



(Filing Date) 
(Date de depot) 



Je revendique par le present acte tout benefice, en vertu du Titre 
35, § 120 du Code des Etats-Unis, de toute demande de brevet 
effectuee aux Etats-Unis, ou en vertu du Titre 35, § 365(c) du meme 
Code, de toute demande internationale PCT designant les Etats-Unis 
et figurant ci-dessous et, dans la mesure ou l'objet de chacune des 
revendications de cette demande de brevet n'est pas divulgue dans la 
demande anterieure americaine ou internationale PCT, en vertu des 
dispositions du premier paragraphe du Titre 35, § 112 du Code des 
Etats-Unis, je reconnais devoir divulguer toute information 
pertinente a la brevetabilite, comme defmi dans le Titre 37, § 1.56 du 
Code federal des reglementations, dont j'ai pu disposer entre la date 
de depot de la demande anterieure et la date de depot de la demande 
nationale ou internationale PCT de la presente demande: 



PCT/IB99/00850 



29 April 1999 



(Application No.) 
(N°de demande) 



(Filing Date) 
(Data de depot) 



I hereby claim the benefit under Title 35, United States Code, 
§120 of any United States applications), or § 365(c) of any 
PCT International application designating the United States, 
listed below and, insofar as the subject matter of each of the 
claims of this application is not disclosed in the prior United 
States or PCT International application in the manner 
provided by the first paragraph of Title 35, United States 
Code, § 112, I acknowledge the duty to disclose information 
which is material to patentability as defined in Title 37, Code 
of Federal Regulations, § 1.56 which became available 
between the filing date of the prior application and the 
national or PCT International filing date of this application. 



Pending 



(Status) (patented, pending, abandoned) 
(Stato) (brevete, en cours d'examen, abandonne) 



(Application No.) 
(N° de demande) 



(Filing Date) 
(Data de depot) 



Je declare par le present acte que toute declaration ci-incluse est, a 
ma connaissance, veridique et que toute declaration formulee a partir 
de renseignements ou de suppositions est tenue pour veridique; et de 
plus, que toutes ces declarations ont ete formulees en sachant que 
toute fausse declaration volontaire ou son equivalent est passible 
d'une amende ou d'une incarceration, ou des deux, en vertu de la 
Section 1001 du Titre 18 du Code des Etats-Unis, et que de telles 
declarations volontairement fausses risquent de compromettre la 
validite de la demande de brevet ou du brevet delivre a partir de 
celle-ci. 



(Status) (patented, pending, abandoned) 
(Stato) (brevete, en cours d'examen, abandonne) 

I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements were 
made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, under Section 
1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any 
patent issued thereon. 
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French Language Declaration 

POUVOIRS: En tant que l'inventeur cite, je designe par la 
presente T(les) avocat(s) et/ou agent(s) suivant(s) pour qu'ils 
poursuive(nt) la procedure de cette demande de brevet et traite(nt) 
toute affaire s'y rapportant avec TOffice des brevets et des 
marques: (mentionner le nom et le numero d'enregistrement). 
Adresser toute correspondance a: 



Adresser tout appel telephonique a: (nom et numero de telephone) 



POWER OF ATTORNEY: As a named inventor, I hereby 
appoint the following attorney(s) and/oragent(s) to prosecute this 
application and transact all business in the Patent and Trademark 
Office connected therewith: (list name and registration 
number). 

Send Correspondence to: 

Jonathan P.0sh3_ 
^ose nt har^rgs hal.L.P. 
756Touisiana, Suite 455Q 
TToTistonTT^s770Q2 

Direct Telephone Calls to: (name and telephone number) 
Jonathan P. Osha (713) 228-8600 



l&om complet de Tunique ou premier inventeur 


Full name of sole or first inventor 
Jerome MERIC 


^Signature de l'inventeur Date 


Inventor'sfeignaturiS Date 

16.10.00 


domicile 


Residence \^_) I 

55, rue de Meaux, F-60300 Senlis, FRANCE 


i Nationalite 


Citizenship 
FRANCE 


: Adresse postale 


Post Office Address 

55, rue de Meaux, F-60300 Senlis, FRANCE 


Nom complet du second co-inventeur, le cas echeant 


Full name of second joint inventor, if any 
Patrice LETOURNEUR 


Signature du second inventeur Date ^ 


Second Inventor^jggatee- Date 

^^^^^ 16.10.00 


Domicile 


Residencer^^ 

44, rue Cluseret, F-92150, Suresnes, FRANCE f -^yS 


Nationalite 


Citizenship 
FRANCE 


Adresse postale 


Post Office Address 

44, rue Cluseret, F-92150, Suresnes, FRANCE 



(Fournir les memes renseignements et la signature de tout (Supply similar information and signature for third and 
co-inventeur supplemental.) subsequent joint inventors.) 



[Page 3 of 3] 



